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Cluster Synchronization of Coupled Systems with 
Nonidentical Linear Dynamics 
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Abstract 

This paper considers the cluster synchronization problem of generic linear dynamical systems 
whose system models are distinct in different clusters. These nonidentical linear models render 
control design and coupling conditions highly correlated if static couplings are used for all individual 
systems. In this paper, a dynamic coupling structure, which incorporates a global weighting factor 
and a vanishing auxiliary control variable, is proposed for each agent and is shown to be a feasible 
solution. Lower bounds on the global and local weighting factors are derived under the condition 
that every interaction subgraph associated with each cluster admits a directed spanning tree. The 
spanning tree requirement is further shown to be a necessary condition when the clusters connect 
acyclicly with each other. Simulations for two applications, cluster heading alignment of nonidentical 
ships and cluster phase synchronization of nonidentical harmonic oscillators, illustrate essential parts 
of the derived theoretical results. 
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I. Introduction 

Understanding the interaction of coupled individual systems continues to receive interest 
in the engineering research community [1], Recently, more attention has been paid to cluster 
synchronization problems which have much wide applications, such as segregation into small 
subgroups for a robotic team [2] or physical particles [3], predicting opinion dynamics in 
social networks [4], and cluster phase synchronization of coupled oscillators [5], [6]. 

In the models reported in most of the literature, the clustering pattern is predefined and 
fixed; research focuses are on deriving conditions that can enforce cluster synchronization for 
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various system models [7]—[17]. Preliminary studies in [7]—[10] reported algebraic conditions 
on the interaction graph for coupled agents with simple integrator dynamics. Subsequently, 
a cluster-spanning tree condition is used to achieve intra-cluster synchronization for first- 
order integrators (discrete time [11] or continuous time [12]), while inter-cluster separations 
are realized by using nonidentical feed-forward input terms. For more complicated system 
models, e.g., nonlinear systems ([13]—[15]) and generic linear systems ([16], [17]), both 
control designs and inter-agent coupling conditions are responsible for the occurrence of 
cluster synchronization. For coupled nonlinear systems, e.g., chaotic oscillators, algebraic 
and graph topological clustering conditions are derived for either identical models ([13]) or 
nonidentical models ([14], [15]) under the key assumption that the input matrix of all systems 
is identical and it can stabilize the system dynamics of all individual agents via linear state 
feedback (i.e., the so-called QUAD condition). For identical generic linear systems which 
are partial-state coupled [16], [17], a stabilizing control gain matrix solved from a Ricatti 
inequality is utilized by all agents, and agents are pinned with some additional agents so that 
the interaction subgraph of each cluster contains a directed spanning tree. 

The system models introduced above can describe a rich class of applications for multi¬ 
agent systems. A common characteristic is that the uncoupled system dynamics of all the 
agents can be stabilized by linear state feedback attenuated by a unique matrix (i.e., static state 
feedback). This simplification allows the derivation of coupling conditions to be independent 
of the control design of any agent, and thus offers scalability to a static coupling strategy. This 
ki nd of benefit still exists for nonidentical nonlinear systems which are full-state coupled, as 
all the system dynamics can be constrained by a common Lipchitz constant (Lipchitz can 
imply the QUAD condition [18]). However, for the class of partial-state coupled nonidentical 
linear systems, the stabilizing matrices for distinct linear system models are usually different. 
Then the coupling conditions under static couplings will be correlated with the control designs 
of all individual systems. This correlation not only harms the scalability of a coupling strategy 
but also increases the difficulty in specifying a graph topological condition on the interaction 
graph. 

The goal of this paper is to achieve state cluster synchronization for partial-state coupled 
nonidentical linear systems, where agents with the same uncoupled dynamics are supposed to 
synchronize together. This is a problem of practical interest, for instance, maintaining different 
formation clusters for different types of interconnected vehicles, providing different synchro¬ 
nization frequencies for different groups of clocks using coupled nonidentical harmonic oscil- 



lators, reaching different consensus values for people with different opinion dynamics, and so 
on. In order to relieve the difficulties in using the conventional static couplings, couplings with 
a dynamic structure is proposed by introducing a vanishing auxiliary variable which facilitates 
interactions among agents. With the proposed dynamic couplings, an algebraic necessary and 
sufficient condition, which is independent of the control design, is derived. This newly derived 
algebraic condition subsumes those published for integrator systems in [7]—[ 10] as special 
cases. Due to the entanglement between nonidentical system matrices and the parameters 
from the interaction graph, the algebraic condition is not straightforward to check. Thus, a 
graph topological interpretation of the algebraic condition is provided under the assumption 
that the interaction subgraph associated with each cluster contain a directed spanning tree. 
We also derive lower bounds for the local coupling strengths in different clusters, which 
are independent of the control design due to the dynamic coupling structure. This spanning 
tree condition is further shown to be a necessary condition when the clusters and the inter¬ 
cluster links form an acyclic structure. This conclusion reveals the indispensability of direct 
links among agents belonging to the same cluster, and further strengthens the sufficiency 
statement presented initially in [16]. Another contribution of the proposed dynamic couplings 
in comparison to those static couplings in [17] is that the lower bound of a global factor 
which weights the whole interaction graph is also independent of the control design. For 
this reason, the least exponential convergence rate of cluster synchronization is characterized 
more explicitly than that in [17]. The derived results in this paper are illustrated by simulation 
examples for two applications: cluster heading alignment of nonidentical ships and cluster 
phase synchronization of nonidentical harmonic oscillators. 

The organization of this paper is as follows: Following this section, the problem formulation 
is presented in Section II. In Section III, both algebraic and graph topological conditions 
for cluster synchronization are developed. Simulation examples are provided in Section IV. 
Concluding remarks and discussions for potential future investigations follow in Section V. 

II. Problem Statement 

Consider a multi-agent system consisting of L agents, indexed by X = {1,... , X}, and 
N < L clusters. Let C = {C±,..., Cv} be a nontrivial partition of X, that is, [j^ =1 C% = X, 
Ci ^ 0, and C % D C, } — 0, Vi ^ j. We call each C* a cluster. Two agents, / and k in X, belong 
to the same cluster C, if l G C t and k € C,. Agents in the same cluster are described by the 



same linear dynamic equation: 


xi{t) = AiXiit ) + BiUi(t), l G C u i = 1,. .., N (1) 

where xi(t) G M n with initial value, xi(0), is the state of agent / and u/(t) G M” 1 ’ is the 
control input; G R nxn and B, G M nxm ' are constant system matrices which are distinct 
for different clusters. 

A. Interaction graph topology and graph partitions 

A directed interaction graph Q = (V,£,A) is associated with system (1) such that each 
agent l is regarded as a node, vi G V, and a link from agent k to agent l corresponds to a 
directed edge (v k , vi) G S. An agent k is said to be a neighbor of l if and only if (v ki v t ) G S. 
The adjacency matrix A = [ ai k ] G R LxL has entries defined by: a ik A 0 if (v k , vi) G S, 
and aik = 0 otherwise. In addition, an = 0 to avoid self-links. Note that a//,. < 0 means that 
the influence from agent k to agent l is repulsive , while links with a ik > 0 are cooperative. 
Define C = [ bi k ] G R LxL as the Laplacian of Q, where bn = Y^k=i a ik an d b ik = —a ik for 
any k ^ l. 

Corresponding to the partition C = {Ci,..., C N }, a subgraph Q % , i = 1,..., N, of Q 
contains all the nodes with indexes in Ci, and the edges connecting these nodes. See Fig. 1 for 
illustration. Without loss of generality, we assume that each cluster Ci, i — 1,..., N, consists 
of h > 1 agents (Y^=i = L )» such that Ci = {1,Zi}, .... = {<7i + 1 ,+ h}, 

..., Cn = {on + 1,..., <Jn + In} where a\ — 0 and a, = J2 ‘ r -1 hi 2 < i < N. Then, the 
Laplacian C of the graph Q can be partitioned into the following form: 
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where each La G specifies intra-cluster couplings and each L l} G M /tXL ' with i A B 

specifies inter-cluster influences from cluster C 3 to C, , i,j = 1, • • • , N. Note that L lt is not 
the Laplacian of Qj in general. 

Construct a new graph by collapsing any subgraph of Q, Qi, into a single node and define 
a directed edge from node i to node j if and only if there exists a directed edge in Q from 
a node in Q % to a node in Q :r We say Q admits an acyclic partition with respect to C, if 



Fig. 1. A graph topology partitioned into two subgraphs. 


the newly constructed graph does not contain any cyclic components. If the latter holds, by 
relabeling the clusters and the nodes in Q, we can represent the Laplacian £ in a lower 
triangular form 

Un 0 I 


£ = 
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so that each cluster C, receives no input from clusters Cj if j > i. In Fig. 1, the two subgraphs 
Qi and Q 2 illustrate an acyclic partition of the whole graph. 


B. The cluster synchronization problem 

The main task in this paper is to achieve cluster synchronization for the states of systems 
in (1) via distributed couplings through the control inputs ui(t) which is defined as follows: 
for l G Ci, % — 1,..., N 


uiit) = Kipiit) 
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(A-i + BiRj)r]i + c 
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where K t is the control gain matrix to be specified; the vector rft(t) G M", l G X is an 
auxiliary control variable with initial value, rft (0); c > 0 is the global weighting factor for 
the whole interaction graph Q; each c, > 0 is a local weighting factor used to adjust the 
intra-cluster coupling strength of cluster Cj. Note that the couplings in (4) takes a dynamic 
structure. The reasons why conventional static couplings (e.g., those in [ 13]—[ 17]) are not 





preferred will be explained in details in the main part. 

The cluster synchronization problem is defined below. 

Definition 1: A linear multi-agent system in (1) with couplings in (4) is said to achieve 
iV-cluster synchronization with respect to the partition C if the following holds: for any xfiO) 
and 772 ( 0 ), l G X, lim*-^ \\xi(t) — x k (t)\\ = 0 Wk, l G C u i = 1,..., N, lim*-^ r) t (t ) = 
0 V/ G X, and for any set of xfiO), l G X there exists a set of 772 ( 0 ), l G X such that 
limsup t ^. oc ||x/(f) - x k (t)\\ > 0 V/ G C h V/c G C,-, Vi 7 ^ j. 

In the definition, all auxiliary variables, 772(f), l G X are required to decay to zero so as 
to guarantee that the control effort of every agent is essentially of finite duration. For state 
separations among distinct clusters, one should not expect them to happen for any set of 
£;(0)’s and 772 (0) ’s; an obvious counterexample is that all system states will stay at zero 
when xi( 0) = 772 ( 0 ) = 0 for all l G X. Some assumptions throughout the paper are in order. 

Assumption 1: Each of the pairs (A,, 13 ,), i = 1,..., N is stabilizable. 

Assumption 2: Each A, has at least one eigenvalue on the closed right half plane. 

This assumption excludes trivial scenarios where all system states synchronize to zero. 
To deal with stable A/s, one may introduce distinct feed-forward terms in ufit) as studied 
in [11], [12]. In order to segregate the system states according to the uncoupled system 
dynamics in (1), an additional mild assumption is made on the system matrices A,’s, namely, 
they can produce distinct trajectories. Rigorously, for any i j, the solutions x,(t) and xfit) 
to the linear differential equations xfit) = Apcfit) and xfit) = AjXj(t), respectively satisfy 
limsup^^ \\xfit) — Xj(t )|| > 0 for almost all initial states a;j(0) and ar,(0) in the Euclidean 
space W n . 

Assumption 3: Every block Lij of C defined in (2) has zero row sums, i.e., Lijl^ = 0. 

This assumption guarantees the invariance of the clustering manifold 

{x(t) = [x^(t),...,xl(t)] T :x 1 (f) = ••• = x ll {t),...,x ffN+ i(f) = ••• =x L (t)}. 

It is imposed frequently in the literature to result in cluster synchronization for various 
multi-agent systems (see [7]—[10], [13], [14], [16], [17]). To fulfill it, one can let positive 
and negative weights be balanced for all of the links directing from one cluster to any 
agent in another cluster. The negative weights for inter-cluster links is supposed to provide 
desynchronizing influences. Note also that with Assumption 3 each L tl is the Laplacian of a 
subgraph Cfi, i = 1,..., N. 

Notation-. l n = [1,1,..., 1] T G M n . The identity matrix of dimension n is I n G R nxn . 



The symbol blockdiag{Mi,..., M N } represents the block diagonal matrix constructed from 
the N matrices Mi,..., “(g)” stands for the Kronecker product. A symmetric positive 

(semi-) definite matrix S is represented by S > 0(S > 0). ReX(A) is the real part of the 
eigenvalue of a square matrix A, and cr(A) is the spectrum of A. 


III. Conditions for Achieving Cluster Synchronization 


In this section, we first present a necessary and sufficient algebraic clustering condition that 
entangles parameters from the Laplacian C and the system matrices s. Then, we present 
some graph topological conditions which offer more intuitive interpretations. 

The following discussion makes use of the weighted graph Laplacian 
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and the following matrix: 
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where each L tJ , i,j — 1,..., N is a block matrix defined as 


(5) 


( 6 ) 


Li'j Lij 1 (. 7 , 


njt 


(7) 


with 


lij 



(Tj + l,(Tj+2? 

1 b(Ti-\-l 1 (Tj-\-lj ] ^ 

b<7i~\- 2,(7 j +2 

^ai-\-2,crj -\-lj 

j +2 

■O) 

+ 

b 1 

+ 

b 


bin— 1 


L-i)x(q-i) 


The two matrices C c and C c have the following relation, whose proof is shown in Appendix 
I. 

Lemma 1: Under Assumption 3, each diagonal block La in C c has exactly one zero 
eigenvalue if and only if the corresponding matrix L lt defined in (7) is nonsingular. Moreover, 
C c defined in (5) has exactly N zero eigenvalues if and only if the matrix C c defined in (6) 



is nonsingular. 


A. Algebraic clustering conditions 

Under Assumption 1, for each i = 1 ,N there exists a matrix P, > 0 satisfying the 
Riccati equation 

Pi-Ai + Aj Pi — PiBiBj Pi = —I. (8) 

Choose the control gain matrices as K % = — BfPi , and denote A = biockdi(ig{Ii ] _- l 0) 
Ai, ..., h N -\ 0 A y}. Then, we have the following algebraic condition to check the cluster 
synchronizability. 

Theorem 1: Under Assumptions 1 to 3, the multi-agent system in (1) with couplings in 
(4) achieves iV-cluster synchronization if and only if the matrix A — dt c 0 /„ is Hurwitz, 
where C c is defined in (6). 

The proof is given in Appendix II. The matrix A — c£ c 0 /,, contains parameters from the 
interaction graph that entangle intimately with those from the system dynamics. In general, 
it is not possible to verify the above synchronization condition by simply comparing the 
eigenvalues of t with those of A/s. However, one can do so for a homogeneous multi-agent 
system as stated in the following corollary. 

Corollary 1: Under Assumptions 1 to 3, and with identical system parameters: Ai = A, 
Bi = B, Ki = K, for all i — 1,..., N, a multi-agent system in (1) with couplings in (4) 
achieves iV-cluster synchronization if and only if the following holds: 

mini?eA(c£ c ) > maxi?eA(A). (9) 

CT(Cc) CT (^) 

A sketch of the proof for this corollary is given in Appendix III. 

Remark 1: In words, the algebraic condition (9) states that the weighted graph Laplacian 
C r has exactly N zero eigenvalues, and all the nonzero eigenvalues have large enough positive 
real parts to dominate the unstable system dynamics described by A. This condition implies 
that related results in [7]—[9] are special cases with A — 0, B — 1 and K = 1. It also 
includes part of the results in [10], which are obtained for identical double integrators. Note 
that with identical system parameters, one can use static controllers without involving the 
auxiliary variables r/z’s. However, in that case the synchronized state in each cluster depends 
linearly on the initials states xz(0)’s only. For certain initial state sets, state separations in 
the limit cannot be guaranteed. 



B. Graph topological conditions 

The matrix A — cC c ® I n in Theorem 1 can be proven to be Hurwitz for certain graph 
topologies in conjunction with some lower bounds on the weighting factors. To do so, the 
following well-known result for subgraphs will be useful. 

Lemma 2 ([19]): Let Q % be a non-negatively weighted subgraph. Then, the Laplacian L„ 
of Qi has a simple zero eigenvalue and all the nonzero eigenvalues have positive real parts 
if and only if Qi contains a directed spanning tree. 

By Lemma 1, there exists a positive definite matrix W t e jjdi-Oxfii-i) such that 

W i L ii + Lj i W i > 0, i — 1,..., N, (10) 

if the corresponding subgraph Q % satisfies the conditions in Lemma 2. Denote 

TV = blockdiag{Wi ,..., Wn}, 


and let 

t 0 = t c -t d , ( 11 ) 

with t ( i = blockdiag{ciLu,... ,cnLnn}- The following theorem states the main result of 
this subsection. 

Theorem 2: Under Assumptions 1 to 3, a multi-agent system in (1) with couplings in (4) 
achieves A-cluster synchronization exponentially fast with the least rate of |[c — A max (A + 
A T )], if each subgraph, Qi, contains only cooperative edges and has a directed spanning tree, 
and the weighting factors satisfy 

c> max A max (Aj + Af), (12) 

and for each i — 1,..., N 

c > A max (W) - A min (VV£ 0 + t T 0 W) 

A rniniWLii + LlWi) 

where each Wi satisfies (10). 

Proof: Following the proof of the sufficiency part of Theorem 1, we need to show that 
the system 


C it) = (A - cC c <g> J n )C(t) 


(14) 



is exponentially stable under the conditions in Theorem 2. First, these conditions guarantee 
the existence of positive definite matrices, Wi s, satisfying (10). Hence, (13) can be written 


c i A min (WiL ii + LlW t ) + A min (VV£ 0 + t T 0 W) > A max (W) 

for i = 1..... N. These inequalities together with Weyl’s eigenvalue theorem ([20]) yield 
the following: 

A min (w4 + t T c W) 

= A min c wc d + t T d w + vvt Q + C T 0 W) 

> A min (W£ d + t T d W) + A min (w4 + t T 0 W) 

> Amax(VV), 

which further implies that 

VV£ C + £j>V > VV. (15) 

Now, consider the Lyapunov function candidate V(t) = Qit 'j' iW ® I n )C(t) for the system 
(14). Taking time derivative on both sides of V(t), one gets 

v(t) = C T (f)(W <g> In) (A - ct c ® In) 

+ (A-ct c ®I n ) T (VV®I n )((t) 

= C T (f)[(W^/„)(A + A T ) 

- C (Wt c + t T c W)®I n ]C,(t) 

< c T (t)[(W <g> I n )( A + A T ) -cW® I n ]((t) 

< ~[c — A max (A + A t )}V (f), 

where the last inequality follows from (12). This confirms the exponential stability of system 
(14), and therefore cluster synchronization can be achieved exponentially fast with the least 
rate of \[c - A max (A + A T )]. ■ 

We have the following comments on the condition in (12): 

1) From the above proof, one can find another lower bound for c as follows: 

c > A max ((VV ® I n )(A + A 7 )) 

A m in(VV£ c + t T c W) 


(16) 



This bound is tighter than that in (12) since the inequality in (15) and A max (Wi) > 
0, A max (/I,; + Aj) > 0 for any i imply that the right-hand side (RHS) of (16) < 

A m ax(VV)A max (^A + A ) _ 0 j' (] 2). However, this tighter bound only guarantees 

A max (W) 

that V(t ) < 0, and does not provide a lower bound on the convergence rate, which 
could be quite slow. Moreover, the RHS of (16) involves all the Cj’s in C c , and no 
known distributed algorithm is available for the computation. 

2) Note that the role of c is more essential in stabilizing the unstable modes of the system 
matrices, A£ s, than in strengthening the connective ability of the interaction graph. 
A global weighting factor similar to c is utilized in a related paper [17] where the 
clustering problem for identical linear systems are solved. In that paper, the global 
factor serves as a parameter in a Ricatti inequality so as to result in a control gain 
matrix. However, using a larger value for that factor does not necessarily increase the 
convergence rate. In contrast, the selection of c in this paper is independent of the 
control design in (8). And the rate of convergence can be improved definitely by using 
a larger value for c. 

The following two remarks explain why we prefer the dynamic couplings in (4) than static 
couplings when dealing with nonidentical linear systems. 

Remark 2: To achieve state cluster synchronization for a group of generic linear systems, 
a natural choice of static couplings is the following (slightly modified from couplings of 
homogeneous linear systems in [16], [17]): for each l e C*, i — 1,..., N 

ui(t) = Ki Ci ^2 kkXk(t) + ^2 b ikXk(t) (17) 

fceCi k^Ci 

However, following a similar procedure as in [17], one will need the following condition 

c i A min ((WiL ii + L?Wi) <g> PiBiBfPi) > p, (18) 

for every i = 1,..., N, where p = A max ((VV (8) I n ) PBB T P) — A min (PBB 7 P(VV£ 0 ® I n ) + 
(C^W ® J n )PBB 7 P). To compute p, one needs information on the control design of all 
agents, i.e., B 7 P = blockdiagll ^-1 ® BiPi ,..., Ii N -\ ® B N P N }. This fact renders the 
selection of local weighting factors, q’s, a centralized decision. Moreover, (18) cannot be 
satisfied by any c t in the nontrivial case that p > 0, and I)B, Bj P, is singular for some i. 
In contrast to (18), the condition (13) specifies explicitly the requirements for q’s, and it is 



independent of the design of control gain matrices. In this sense, the dynamic couplings in 
(4) are preferable to the static ones in (17). 

Remark 3: For nonidentical nonlinear systems of the form, xi(t) = /,(:/'/, t), l £ C ,, static 
couplings are used to result in closed-loop systems as follows ([14], [15]): 


} - r 


<k ^ bi k x k {t) + ^2 bikX k {t ) 

k£.Ci k(£Ci 
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where T is a constant (usually nonnegative-definite) matrix. It was shown that clustering 
conditions involve the graph Laplacian only (see [15]) if all individual self-dynamics are 
constrained by the so-called QUAD condition: for any x,y £ M", (x — y) T [fi(x) — fi(y ) — 
r (x—y)] < —u(x — y) r (x — y), where u > 0 is a prescribed positive scalar. For generic linear 
systems with static couplings in (17), this QUAD condition requires that for any x £ M n , 
x T (Ai — T)x < — cox' 1 'x with F = B,K, for all i — 1,..., N. Given a Y. for the existence of 
control gains Kfs, one needs all U,’s to satisfy Rank(Bi) = Rank([Bi F|). However, this 
rank condition is too restrictive. For example, for the models in (21), an applicable choice of 
T is R, but then Rank( B, ) < Rank([Bi F] ) and thus no K, can be solved from F = B,K,. In 
contrast, the dynamic couplings in (4) do not impose such constraints on the system models. 

Generally, it is not always necessary to let every subgraph contain a directed spanning 
tree. In fact, agents belonging to a common cluster may not need to have direct connections 
at all as long as the algebraic condition in Theorem 1 is satisfied. This point is illustrated 
by a simulation example in the next section. Nevertheless, the spanning tree condition turns 
out to be necessary under some particular graph topologies as stated by the corollary below. 

Corollary 2: Let Q be an interaction graph with an acyclic partition as in (3), and let the 
edge weights of every subgraph Q t be nonnegative. Under Assumptions 1 to 3, a multi-agent 
system (1) with couplings in (4) achieves A r -clustcr synchronization if and only if every Q, 
contains a directed spanning tree, and the weighting factors satisfy 


max ff(i .) ReX(Ai) 
ReXilu) ’ 


(19) 


where each L iif is defined in (7). 

Proof: By Theorem 1, we can examine the stability of A — cC c <g) I n . Let T, £ 
R(F-iUG-i), i = 1,..., N, be a set of nonsingular matrices such that Tf 1 L t ,T t = Jj, 
where J, is the Jordan form of L tl . Denote T = blockdiag{T ! ® 7 m ..,, T N ® I n }. Then, the 





Fig. 2. Interaction graph partitioned into two clusters C\ = {1,2} and C 2 = {3,4} (a) cyclic partition (b) acyclic partition. 


block triangular matrix T _1 (A — ct c <g) If )T has diagonal blocks — Ci\k(Ln)I n , where 
Cj = c ■ Ci, k = 1,..., li — 1, i = 1,..., N. Hence, the matrix A — cC c ® I n is Hurwitz if 
and only if q min^ ReXfLa) > max,,, Re\ rn {A r ) for any i. This claim is equivalent to the 
conclusion of this corollary due to Lemma 2, the first claim of Lemma 1, and Assumption 
2 that requires max m ReX m (Ai) >0. ■ 

This corollary reveals the indispensability of direct links among agents in the same cluster 
under an acyclicly partitioned interaction graph. Note that such direct communication require¬ 
ments for intra-cluster agents is not necessary under a nonnegatively weighted interaction 
graph (see [11], [12], [15] for references). 

Remark 4: It is worth mentioning for the condition in (19) that one can set Q = 1 for all 
i, and adjust the global factor c only to result in cluster synchronization. In contrast, without 
the acyclic partitioning structure, the local weighting factors c,;’s need to satisfy the lower 
bound conditions in (13). Note that (19) specifies the tightest lower bound for c, while a 
lower bound reported in [16] for identical linear systems via Lyapunov stability analysis can 
be quite loose. 


IV. Simulation Examples 

In this section, we provide application examples for cluster synchronization of nonidentical 
linear systems. We also conduct numerical simulations using these models to illustrate the 
derived theoretical results. 

A. Example 1: Heading alignment of nonidentical ships 

Consider a group of four ships with the interaction graph described by Fig. 2(a), where 
ship 1 and 2 (respectively, ship 3 and 4) are of the same type. The purpose is to synchronize 











the heading angles for ships of the same type. The steering dynamics of a ship is described 
by the well-known Nomoto model [21]: 


ipi(t) = Vi(t) 

Vi(t) = Vi(t ) + —Ui(t) (20) 

Ti Ti 


where Wi is the heading angle (in degree) of a ship l <G 1, vi (deg/s) is the yaw rate, and ui 
is the output of the actuator (e.g., the rudder angle). The parameter r, is a time constant, and 
K t is the actuator gain, both of which are related to the type of a ship. Define for i = 1,2 
the system matrices 


A = 


0 1 

, Bi = 

0 

0 —— 


Ki 

Ti_ 


_ T i _ 


( 21 ) 


and assume that T\ = 42.21, r 2 = 107.3, — 0.181, k 2 = 0.185. The solutions to the 
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Riccati equations in (8) are given by Pi = 

233.2 

3915.4 

and P 2 = 

580 

16875 


which lead to the control gain matrices K\ = —[1 16.79] and K 2 = —[1 29.09]. Since 
rnax, = i ; 2 A max (A + Af) = 0.99, we set c = 1 according to (12). 


The weighted graph Laplacian is given by 


0 0 5 -5 

— Ci Ci 1 —1 

-110 0 

0 0 — c 2 c 2 


which yields t c = 


ci 4 
-1 c 2 


using the definition in (6). So, L Vi 


1 , L -22 = 1, and for any 


il'i > 0 and W 2 > 0, the inequalities in (10) hold. We choose W\ — W 2 — 1. It follows that 
Amax(VV) = 1, A min (VV£ 0 + t T 0 W) = -3, and A min (fy i L ii + L^W,) = 2 for i = 1,2. Then, 
we can choose ci = c 2 = 2 so that the inequalities in (13) are satisfied. Simulation result in 
Fig. 3(a) shows that cluster synchronization is achieved for the heading angles (the velocity 
vi(t) of every agent will converge to zero as shown in Fig. 3(b)). 

Now, let ci = 0 so that agents 1 and 2 in cluster C\ have no direct connection. Cluster 
synchronization is still achieved as shown in Fig. 3(c). This example illustrates that intra¬ 
cluster connections are not necessary for cluster synchronization under a cyclicly partitioned 




(a) Under the graph in Fig. 2(a), cluster synchro¬ 
nization is achieved with ci = C 2 = 2. 



(c) Under the graph in Fig. 2(a), cluster synchro¬ 
nization is achieved with ci = 0, C 2 = 2. 



(b) Under the graph in Fig. 2(a), the velocity 
vi(t) of every ship converges to zero. 



(d) Under the acyclic partitioning graph in Fig. 
2(b), ipi’s in the first cluster cannot synchronize 
together. 


Fig. 3. Evolutions of and vi(t) for the ship heading steering dynamics in (20) connected with graphs in Fig. 2. 


interaction graph. However, under an acyclic partition as in Fig. 2(b), the first cluster of 
agents, having no direct connections, cannot achieve state synchronization as shown in Fig. 
3(d). ■ 

B. Example 2: Cluster synchronization of oscillators 

The studied cluster synchronization problem for nonidentical linear systems may find 
applications in the coexistence of oscillators with different frequencies. To see this, let us 
consider two clusters of coupled harmonic oscillators with graph topology in Fig. 4(a), where 
the first cluster contains a sender si and two receivers r | and r 2 , the second cluster contains 
a sender s 2 and two receivers r 3 and r 4 , and the four receivers are coupled by some directed 
links. Assume the angular frequencies of the two clusters of oscillators are W\ = 2 rad/s and 















































Fig. 4. (a) Interaction graph partitioned into two clusters C\ = {si,ri,r 2 } and C 2 = {s 2 , f 3 , ^ 4 }. (b) Evolutions of the 

first components of the nonidentical harmonic oscillators under the graph in Fig. 4(a). 


w 2 = 2.5 rad/s, respectively. So, the dynamic equation of each oscillator is 

xu(t) = x 2i {t ), 

x 2 i(t) = —wlxuit) +Ui(t), l G Ci, i = 1, 2 (22) 


which corresponds to the following system matrices: 


Ai = 


0 

~W; 


2 0 


, Bi = 


, f = 1,2. 


The objective is to let the receivers of each cluster follow the state of the sender. 

By a similar design procedure as in the previous example, we can set K\ = — [0.1231 1.1163], 
K 2 = —[0.0554 1.0539], c = 6, and c\ = c 2 = 13. Simulation result in Fig. 4(b) shows the 
synchronous oscillations of the harmonic oscillators with two distinct angular frequencies. 


V. Conclusions 

This paper investigates the state cluster synchronization problem for multi-agent systems 
with nonidentical generic linear dynamics. By using a dynamic structure for coupling strate¬ 
gies, this paper derives both algebraic and graph topological clustering conditions which are 
independent of the control designs. For future studies, cluster synchronization which can only 
be achieved for the system outputs is a promising topic, especially for linear systems with 
parameter uncertainties or for heterogeneous nonlinear systems. For completely heterogenous 
linear systems, research works following this line are conducted by the authors in [22] 
and others in [23]. For nonlinear heterogeneous systems, the new theory being established 





















for complete output synchronization problems [24], [25] may be further extended. Another 
interesting challenge existing in cluster synchronization problems is to discover other graph 
topologies that meet the algebraic conditions. 


Appendix I 
Proof of Lemma 1 

Proof: Let S = blockdiag{S \,..., Sn}, where Si = 


1,..., N. Clearly, Si has the inverse matrix S i 1 = 


1 0 

lti-i hi -1 
0 


G R liXli for i = 


—1 z,— i II- i 


one can show that 





L 



s; 

1 L 

ijSj — 

0 

7 ij 
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Lij 


This implies the first claim when 

i = 

-- J- 





For the second claim, consider 

that 







"o 

7n 


■ 0 

llN 



0 

c\Ln 


■ 0 

Lin 

S _1 £ C S 

= 








0 

Ini 


■ 0 

7-Viv 



0 

Lm 


■ 0 

cnLnn 


. By direct computation 


Rearrange the columns and rows of S 1 £ C S by permutation and similarity transformations 
to get the following block upper-triangular matrix 


Oixiv 7n 


7i n 


OlxiV 7-V1 • • • 'JNN 

P(L-N)xN h-c 


where C c is defined in (6). Then, the second claim of this lemma follows immediately. 



Appendix II 


Proof of Theorem 1 

Proof: The closed-loop system equations for (1) using couplings (4) are given as 


Ci ^ bi k Ez k + ^2 hkEz k 

k^Ci k(£Ci 


zi = A ci zi - c 

L 

for all l e Ci, i — 1..., N, where zi = \x {, r{[] T and 

A r ; = 


(23) 


Ai 

BiKi 

, E = 

0 0 

0 

Ai + BiKi 


In In 


(24) 


Let eft) := zft) — z ai+ i(t) for l e C* and l <Ji +1, i = 1,..., N. It follows from (23) and 
Assumption 3 that 


eft) = A ci eft) - c 


Cj ^ (bik b ( j i ^.\ } i )Eek{t) 
. keCi 


T ^ ' (bik b ai +ij~)Eek(t) 

HCi 

Define a nonsingular transformation matrix Q as follows: 


(25) 


Q = 


In 0 


In In 


, Q~ l = 


In 0 


In I'n 


(26) 


and let eft) := [Cf (t), CF(t)] T = Q 1 eft). Clearly, & = x t - x ai+ i and (i 
xi + x ai+1 . By (25), one can obtain the following dynamic equations: 


= m - Vat+l 


ift) = (Ai + BjQCft) + BJuCft), 


cft) = AC ft) - C 


r/ ' ( bik ^cr;+i,fc)Cfc(f) 

. keCi 


+ 2 >* b(n+l,k)^k{t) j 

kafiCi 


for l e Ci and l f a, + 1, t = 1,.... N. Since I\, stabilizes (/1 ? , Bf), the variable eft) tends 
to zero as t —> oo if and only if (ft) tends to zero. Denote 


CO) = [Cl[+ 2 (t),---Aa 1 +i 1 ( t )r-- ,C N+2 (t),...,£ N+ iM T > 



which evolves with the following differential equation 

C (t) = (A - cC c 0 J n ) C (t). (27) 

Clearly, ((t) and every £ t (t) (hence every ei(t)) all converge to zero if and only if A — c£ c 0 / n 
is Hurwitz. That is, we have shown that lim,^^ || xi(t) — x k (t )|| = 0 and lim^oo ||^(f) — 
rjkit) || = 0, VI, k G Cu i = 1,..., N. 

Next, we prove that 77 ; (f) for any / G I vanishes as t —> oo. To this end, for each 
i — 1, .».., N, let r)i(t) be the solution of ij, ( t) = (A* + B,K,) //,( t) with an arbitrary initial 
value r)i(0). Since J^kec^ hk = 0 V/ G X by Assumption 3, we have that 


riiit) = (Ai + BiKi)rji(t ) 


= (Ai + BiKi)r)i(t) - c 


Ci(^bi k )(r] (Ti+1 -x (Ji+ 1) 


keCi 


N 


E <E blk)(VtTj + l ~ Xcjj+l ) 

j=l,j¥=i k^Cj 


for any l G C t . Subtracting the above from (4b) yields 


f]i(t) - fji(t) = (Ai + BiKi)(rji(t) - rji(t )) 

( 

-c\dY^b lk ( k + blkCk 

y fcgCi j=l,j^=ik£Cj 

The above system is exponentially stable and driven by inputs which all converge to zero 
exponentially fast. Therefore, for any 77 /( 0 ), ( G X, we have 77 ; (t) —> rji(t ) —* 0 V/ G C t , as 
t —> 00 . 

Lastly, we show that inter-cluster state separations can be achieved for any initial states 
37 /( 0 )’s by selecting 7//(0)’s properly. Given any set of 37 /( 0 ), l G X, choose 77 /( 0 ), l G X such 
that 37 /( 0 )— 77 /( 0 ) = av i+ i( 0 )- 77 <Ti+ i( 0 ) for all Z G C it % = 1..., N, and limsup^^ ||e Ait [a;/(0)- 
77 /( 0 )] —e Ajt \xi( 0) — 77 /( 0 )] || ^ 0 for any i ^ j. Considering the definition of Q and the linear 
differential equation (27), one has xi(t) — 77 / (f) = x ai+ \(t) — 77^+1 (£) for all t > 0. This 
together with (4) lead to the following dynamics 



xi(t) - fji(t) = Ai(xi(t) - rji(t)), VI G C/. 



It follows that 


xi(t) = e Ait [xi{ 0 ) - 17 /( 0 )] + rji(t) 

—> e Ait [xi( 0) — 77 /( 0 )], V/ € C* as t —> oo. 

Therefore, limsup^^ || xi(t) — x k (t) || f 0 V/ G C t , \/k e Cj, Vi f j. This completes the 
proof. ■ 

Appendix III 
Proof of Corollary 1 

Proof: The proof for the necessity and sufficiency of (9) is straightforward using the 
results in Lemma 1 and Theorem 1, and thus is omitted for simplicity. We only show that 
state separations are possible for any initial states xi(0), l el by using the dynamic couplings 
even for systems with identical parameters. 

Constellate the states zft) = [xf (f), rj[(t)] T of all L agents to form 

z(t) := z* z t l (t)] T . 

It follows that 

z(t) — (I L ® A c - cC c ® E)z(t), (28) 

A BK 0 0 

with A c = and E = . One can derive, after a series of manipu- 

0 A + BK —I n I n 

lations, that 

liivJ)®e Act z(0), as t —> oo, 

where each u, = [u a ,..., u iL ] T 6 R L is a left eigenvector of C c such that vjC c = 0, 
vJlH = 1, and vj/i 3 = 0, Vi ^ j, with /m = [lj, 0£_ Z J T , /i 2 = [0£, 1 f 2 , 0 l_ h _ h ] T , • • •, Pn = 
[o T L - lN ,il] T . It then follows from the definitions of zft) and z(t) that for all l e C*, 

L 

x i(t) -> ^2 u ik [e At x k (0) + ( e {A+BK)t _ e Ai )77fc(0)] 

k=l 

L 

^e M E Vik[xk{ 0) - 7?fc(0)], as t -> oo. 

fc=i 

Since A is non-Hurwitz, e At is nonzero as t —* oo. Then, for any set of initial states x/(0). 




I G X, one can always find a set of 77 /( 0 ), l G X such that limsup^^ \\xi(t) — x k (t) || ^ 0 for 
any two agents l G C, and k G C :n 1 ^ j. This completes the proof. ■ 
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